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' _ 1 Abstract 

o 

£N| In this paper, we study the data gathering problem in the context 

^ of power grids by using a network of sensors, where the sensed data 

have inter-node redundancy. Specifically, we propose a new transmis- 
sion method, called quantized network coding, which performs linear net- 
work coding in the infinite field of real numbers, and quantization to 
accommodate the finite capacity of edges. By using the concepts in com- 

| pressed sensing literature, we propose to use l\ -minimization to decode 

the quantized network coded packets, especially when the number of re- 

HH ceived packets at the decoder is less than the size of sensed data (i.e. 

number of nodes). We also propose an appropriate design for network 
O coding coefficients, based on restricted isometry property, which results 

in robust £i-min decoding. Our numerical analysis show that the proposed 
quantized network coding scheme with ^i-min decoding can achieve sig- 
nificant improvements, in terms of compression ratio and delivery delay, 

^-H compared to conventional packet forwarding. 

o 

(N 

^ 1 Introduction 

Based on the data, reported by North American electric reliability council on 
CN| 162 disturbances in the power system, problems in real-time monitoring and 

control system, communication system, and delayed restoration were the major 
cause of these disturbances pQ . This fact indicates the importance of information 
J^~j infrastructures for reliable and economic operation of power systems. In the past 

rS decade, sensor networks have been widely proposed (and in some cases used) as 

a promising technology to enhance the future of electric power grid, in different 
aspects, including power generation, distribution and utilization [2]. 

As the primary element of information chain, collection of sensed data by 
sensor networks is a critical task in monitoring and control of power grids. Espe- 
cially, we are interested in data collection in a power substation, where most of 
the sensed data are naturally (inter-node) correlated. Motivated by this appli- 
cation, we study data gathering scenario (in which messages of different nodes 
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Qubec/McGill Industrial Research Chair in Interactive Information Infrastructure for the 
Power Grid. 
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are transmitted to a single node) for correlated sensed data, especially when 
they are sparse in some transform domain. Specifically, we compare conven- 
tional packet forwarding with network coding and present our proposed net- 
work coding based data gathering, followed by a discussion on its theoretical 
and numerical guarantees. 

It is proved that by using packet forwarding via optimal routing, one can 
achieve the cut set upper bound [3J on the information rates of independent 
sources, in data gathering scenario [4]. For the case of correlated sources, op- 
timal distributed source coding and packet forwarding can achieve maximum 
throughput of the network in data gathering scenario and there is no through- 
put advantage for using network coding 0]. But, this requires the knowledge 
of source dependencies and network deployment to be available at all nodes, 
which signifies the importance of using network coding. Moreover, flexibility 
and robustness to deployment changes have drawn attention to network coding, 
as a good alternative for packet forwarding. 

Random linear network coding for correlated messages has been studied in 
[5 , for the case of two messages (n = 2) and an upper bound on error probability 
of a so called a-decoder is derived. Recently, the idea of using the concepts of 
compressed sensing in data gathering scenario has been proposed in a number 
of papers [B][7][5], where different applications are considered. Fcizi et. al. 
have proposed the idea of joint source and network coding in which a random 
mapping is aligned with analogue network coding [5] to decrease temporal and 
spatial redundancy of sensor data [7] [H] . 

Unfortunately, there is not any published result, which discusses the theoret- 
ical requirements of local network coding to ensure robust recovery of messages. 
We address this by formulating data gathering scenario with network coding 
and discussing theoretical requirements for robust compressed sensing (£i-min) 
decoding. 

Our proposed Quantized Network Coding (QNC) with ^i-min decoding is 
formulated in section [2j The discussion on the design of local network coding 
coefficients and theoretical feasibility of ^-min decoding, using restricted isom- 
etry property is presented in section [3j which is followed by deriving an upper 
bound on the recovery error of ^i-min decoder in section[4j Finally, in sectionJEJ 
we present our simulation results and discuss our conclusions in and section [6J 

2 Quantized Network Coding 

Consider a sensor network, represented by a directed graph, Q = (V, £), where 
V = {1, . . . ,n} and £ = {1, . . . , are the sets of nodes and edges (links), 
respectively. Each edge, e, can maintain a lossless communication from its tail 
node, tail(e), to its head node, head(e), without any interface from other edges, 
at a maximum rate of C e bits per channel use. This implies that the input 
and output contents of edge e, at time t, represented by y e (t), are the same. 
Furthermore, y e (t) is from a discrete finite alphabet of size 2 LCc , where L is the 
block length, used for transmitting over edges. We define the set of incoming 
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edges to node v, as In(v) — {e : head(e) = v}, and outgoing edges from node v, 
as Out(v) = {e : tail(e) = v}. 

We assume that each node includes a random information source, X v , which 
generates, (random) message x v . Furthermore, the messages, x = [x v : v € V] S 
1Z n , are such that there is a linear transform matrix, 4> nxn , for which x — <f)-s, 
and s is fc-sparse (has k non-zero elements) . Referred as data gathering scenario, 
all of the messages, a;„'s, are transmitted to a single node, vq € V, called gateway 
(or decoder) node. 

In networks with finite link capacities, conventional linear network coding 
should be performed in finite field where the operations are closed in the field 
[TP] . However, since theoretical results of compressed sensing are developed for 
the field of real numbers, we propose to perform linear network coding in real 
field and then quantize the results to couple with the finite capacity of outgoing 
edges. Specifically, for all v € V and e € Out(v), we define QNC, according to: 

Ve(t) = Q e [ J2 Pe,e>(t)y e {t-l) + a e , v (t) X v ], (1) 
e'Eln(v) 

where Q e [.] is the quantizer, associated with the outgoing edge e, and /3 e , e '(i) 
and a ejV (t) are the corresponding network coding coefficients, picked from real 
numbers. Time index, t, is integer and represents the time during which blocks of 
length L, representing quantized network coded packets are transmitted over all 
edges. Messag supposed not to be changing with t and are constant 

until they are decoded. Initial rest condition is also assumed to be satisfied in 
our QNC scenario: t/ e (l) = 0, V e G £ . Representing the quantization error by 
n e (t), QNC can be reformulated according to: 

Ve(t)= &.«'(*) Ve[t - 1) + a e , v (t) x v +n e (t). (2) 
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Moreover, we assume bounded source values, so that: Vt> € V, < 
To have |y e (t)| < +Qmax, for all e € £, we pick network coding coefficients such 
that at each node v: 

\Pe,e>(t)\ + \a e , v (t)\<l,VveV,VeeOut{v). (3) 

e' Eln(v) 

By defining vectors of edge contents, y(t) = [y e {t) ■ e G £], and quantization 
noises, n(t) — [n e (t) : e G £], we have: 

y(t) = F(t) ■ y(t - 1) + A(t) ■ x + n(t), (4) 

where F(t), and A(t) are defined according to: 

mm.m ■■ w>h, = { t At) ; Si head(e,) <») 
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By considering Q as the difference equation for a linear system with n(t) 's and 
x as its input, and the content of gateway incoming edges as its output, and 
using the results in jllj . the marginal measurements, {z(t)}i, at time t, are given 
by: 

z(t) = [y e (t) : e g In(v )} = B ■ y(t) = *(t) ■ x + n eff (t), (7) 

where 



*(*) 
n eff (t) 

and B is defined such that: 
{Bh, e = 



t t'+i 

f=2 t"=i 
t t'+l 



1 , i corresponds to e, eg In(vo) 
, otherwise 



(8) 
(9) 

(10) 



By storing enough marginal measurements, at the decoder, we build up the total 
measurements vector, z tot (t), as follows: 



z{2) 



*tot(i) ■ x + ?i eff tot (t), 



(11) 



where the total measurement matrix, ^tot(t)> and total effective noise vector, 
n e fj tot (t), are calculated as follows: 



*(2) 



*(*) 



(0 



*eff 



(2) 



(*) 



(12) 



It is now desired to recover original messages, x, from the noisy measure- 
ments, z tot (t), assuming that enough measurements are stored at the decoder. 
Specifically, we are interested in investigating the feasibility of compressed sens- 
ing decoding by using ^-minimization, when the number of measurements 
({ztot(t)}i, 1 < i < m, and m — (t — l)|/n(uo)|) is less than number of mes- 
sages, n; that is: m < n. 



3 Design of Network Coding Coefficients 

For compressed sensing with ^i-min decoding, appropriate measurement ma- 
trices should be used [T^]. Specifically, Matrices with good norm conservation 

1 Since we assume transmission starts from t = 1, at which initial rest condition holds, 
{z(l)}i's are all zero and not useful for decoding. 
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properties are shown to be good choices, in this case [13] • Restricted Isometry 
Property (RIP) is defined to characterize this norm conservation. Explicitly, 
©to*(i) = ^tat(t)(j> is said to satisfy RIP of order k with constant Sf. if we have: 

1-4 < l|Qt ° t( ^ <i + S k , Vsen n , \\s\\ <k. (13) 
lkll 2 

It is also shown that random matrices with independently and identically dis- 
tributed zero mean Gaussian entries of appropriate dimension satisfy RIP with 
overwhelming probability [14] . Such measurement matrices are also global, in 
the sense that the choice of cj> does not affect the satisfaction of RIP. In the 
following, we present a theorem, which summarizes the result of our work on 
designing local network coding coefficients such that the resulting ^tot(t) (and 
also @tot(t) = ^tot(t)4>) is appropriate for compressive sensing. 

Theorem 3.1 If the network coding coefficients, a e ^ v (t) and (3 eye '{t), are such 
that: 

• a e>v (t) — 0, V t > 2, and a ej „(2) 's are independent zero mean Gaussian 
random variables, 

• p eiB i (t) 's are deterministic, 

then the resulting total measurement matrix, ^tot{t), has zero-mean Gaussian 
entries, and for every v,v' € V, where v ^ v' , {<5 tot(t)} m omd {^tot(t)}iv' are 
independent. ^\ 

The proof of this theorem is omitted for lack of space; it is based on manip- 
ulation of Gaussian random variable and their linear combinations. 



The beauty of this proposed design (based on conditions of theorem 3.1) is 
that there is no need to have an extra overhead communication between the 
nodes, in order to generate appropriate network coding coefficients. 



4 Recovery Error Bound for £i-min Decoder 

In the following, we derive an upper bound for the £2-norm of recovery error of 
QNC with ^i-min decoder (which itself can be implemented by linear program- 
ming [H]). 

Theorem 4.1 Consider a data gathering scenario with k-sparse messages, x, 
and sparsity transform <p, where \x v \ < q max , V v. Assume at all nodes, QNC 
with uniform quantizer of step size Aq_ c (possibly different for each e ) and 
network coding coefficients a ejV (t) and f3 e>e i{t) is performed. Network coding 
coefficients are also assumed to satisfy the condition of Eq. [$| In such network, 
if^totif) and <j> are such that ^tot(t) ■ <f> satisfies RIP of order 2k with a constant 

2 The structurally zero entries of F(t)'s do not let us have the same variances for entries of 
*tot(t)- 
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< V% ~ 1; and x(t) is the recovery result of i\-min decoder of Eq. 14 with 
e 2 (t) calculated according to Eq. 1 1 then the £2 -norm of recovery error is upper 
bounded as in 



■ ■ argmm||s 1^, 



(14) 



subject to: \ \z tot 



\x — x_\\ 2 < ci e 2 (t) 



Cl 



'>2k 



"l-(l + >/§)* 



2 k 



1 t t'-i t 



t'=2 t"=l 
i'-l 



t"'=t"+2 



(15) 
(16) 

(17) 



A n = 



{"=1 f"'=t"+2 

[A Q , e : e e £} 



A, 



(18) 



Proof Since the network is lossless and network coding coefficients satisfy the 
condition of Eq.[3j and |x v | < q max , V v, the only associated noise is quantization 
noise at each edge. As a result of having uniform quantizers, we have: |n e (t)| < 
V e € £■ Equivalently, the absolute value vector of n(t), represented by 
\n(t)\, is such that: \n(t)\ < gAg. Therefore, \n e ff{t)\ can be upper bounded 
as follows: 



n eff (t)\ < n nt": 

t' = l t"=t'+2 



(19) 



This implies: 



\Thff,tot 



(t)\ 



Elk//(0||, 



(20) 



where e 2 (t) is as in Eq. 17 Now, by applying theorem 1.2 in [T3] and using (20), 
theorem is proved. I 

Since for uniform quantizers Ag e is equal to 2q max / (2 LC " — 1), the upper 
bound in the theorem, c\t is decreases when the block length, L, is increased. 
However, this will result in an undesirable increase on the delivery delay in the 
network, which requires us to find the optimal L for each quality of service (i.e. 
SNR). 
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5 Simulation Results 



We evaluate the performance of QNC in terms of average Signal to Noise Ra- 
tio (SNR), SNR(t) — lQlog 10 (||a:|| 2 /||a; — x (t)\\ 2 ), and average delivery delay, 
T<j(t) = L(t — 1), where the averaging is done over different realizations of sim- 
ulation runs, i.e. network deployments. 

To set up the simulations, we randomly generate networks of nodes, in which 
directed edges with unit capacity, i.e. C e = 1 \-r — —, 1, V e, are randomly 

° c "-channel use' 1 1 J 

spread between different pairs of nodes. One of the nodes is randomly picked to 
be the gateway node, Vq, at which the messages are recovered. Simulations are 
repeated by generating f 50 different random realizations of network deployments 
to obtain smoothed results. 

For each generated random network deployment, we perform QNC for dif- 
ferent values of message sparsity factor; i.e. £ = 0.1,0.2,0.3. Specifically, 
to generate messages, x, we first generate a £;-sparse random vector, s, whose 
components are uniformly distributed between — \ and + g . This is followed by 
generation of an orthonormal random matrix, (j>, calculating <p-s and normalizing 
the results between —q max and +q m ax to obtain x. Moreover, network coding 
coefficients, a e , v (t) and /3 e! e<(i), are generated according to the conditions of 
theorem 3.1 and normalizing the results to satisfy the condition of Eq. [3] and 
prevent overflow. At the decoder, the received measurements up to t, z tot {t), 
are used to recover x(t), according to ( 14 ), which is calculated by using the open 
source implementation in |15j . 

For each deployment, we also simulate a routing based packet forwarding 
and compare its performance with QNC. To find the routes from each node to 
the gateway node, we calculate the shortest path from each node to the gateway 
node, using the Dijkstra algorithm [16]. Obviously, in this case, the only asso- 
ciated error for received packets (messages) at the decoder is the quantization 
noise at the source nodes. 

In each case of QNC and packet forwarding, we find the optimal block length, 
L, by repeating the simulations for different integer values of L and then picking 
the smallest r<j(t) for each value of SNR(t). The average SNR - average delivery 
delay curves, resulting from optimizing the block length for QNC and packet 
forwarding, are depicted in Fig. [T] As shown, in all of the cases, the proposed 
QNC with ^i-min decoding outperforms packet forwarding in small delivery 
delays, which corresponds to small number of received measurements at the 
decoder. However, when the number of received measurement passes a certain 
threshold and increases, the SNR of £i-min decoder can not beat that of packet 



forwarding. Even for 1100 edges in Fig. 1(b) QNC fails to achieve the same 
SNR as packet forwarding. To explain this, we should note that for higher 
SNR values, we may need to collect more measurements at the decoder, which 
requires a larger t. Since a larger t is picked for decoding the messages, more 
quantization noises are contributed to the measurements, which increases the 
^2-norm of effective measurement noise. 
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6 Conclusions and Future Works 



Joint source and network coding of sparse messages was discussed in this paper. 
As a good alternative for packet forwarding, linear network coding in the real 
field, is coupled with quantization, to gather sparse data in a decoder node. 
Moreover, the required conditions for theoretical guarantee of ^-min recovery 
was discussed and an appropriate design for network coding coefficients, in terms 
of RIP, was proposed. Finally, in section[5j by using simulations, we have shown 
the promising performance of ^i-min recovery for quantized network coded pack- 
ets, in terms of SNR versus delivery delay. As our future plan, we are interested 
to derive theoretical guarantees for satisfaction of RIP of ^totit), resulted from 
our designed network coding coefficients. It is also planned to apply our QNC 
with €i-min decoding to realistic data gathering scenarios in power substations. 
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Figure 1: A vera ge S NR v ersus average delivery delay of QNC and Packet For- 
warding for [(a)! 1400 [(bjl 1100 edges and | = 0.1,0.2,0.3. 



10 



